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LINEARIZATION OF AN INCREMENTAL PRINTER BY MEASUREMENTS 



2 REFERRED TO A MEDIA- INDEPENDENT SENSOR CALIBRATION 

3 
4 

5 RELATED PATENT DOCUMENTS 

6 

7 Related documents are other, coowned U. S. utility- 

8 patent documents hereby incorporated by reference in their 

9 entirety into this document. One is in the names of Pau 

10 Soler et al > . attorney docket 60004608Z141 , entitled ^^COM- 

11 PENSATING FOR DRIFT AND SENSOR PROXIMITY IN A SCANNING 

12 SENSOR, IN COLOR CALIBRATING INCREMENTAL PRINTERS'' and la- 

13 ter assigned U. S. patent application serial / , ^ 

14 issued as U. S. 6, , ; another of Francesc Subirada 

15 et al > , attorney docket 60002868Z136, entitled ^'TEST-BASED 

16 ADVANCE OPTIMIZATION IN INCREMENTAL PRINTING: MEDIAN, 

17 SENSITIVITY-WEIGHTED MEAN, NORMAL RANDOM VARIATION^' and 

18 later assigned U. S. patent application serial / , , 

19 issued as U. S. 6, , ; still another of Francesc Su- 

2 0 birada et al . , U. S. application serial 09/034,722, "SCAN- 

21 NING AN INKJET TEST PATTERN FOR DIFFERENT CALIBRATION AD- 

22 JUSTMENTS", issued as U. S. 6, , ; another of Thomas 

23 H. Baker et al. > serial 09/183,819 entitled "COLOR-CALI- 

24 BRATION SENSOR SYSTEM FOR INCREMENTAL PRINTING" and issued 
2 5 as U. S. 6, , ; yet another of Francis Bockman and 

2 6 Guo Li, entitled "CONSTRUCTING DEVICE-STATE TABLES FOR 

27 INKJET PRINTING", U. S. application serial 08/960,766, 

28 issued as U. S. 6, , ; and U. S. 5,796,414 of Otto 

29 Sievert et al . . "SYSTEMS AND METHOD FOR ESTABLISHING POSI- 

3 0 TIONAL ACCURACY IN TWO DIMENSIONS BASED ON A SENSOR SCAN 
31 IN ONE DIMENSION". 

32 
33 
34 
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1 FIELD OF THE INVENTION 

2 

3 This invention relates generally to machines and pro- 

4 cedures for incremental printing of text or graphics on 

5 printing media such as paper, transparency stock, or other 

6 glossy media; and more particularly to calibration of a 

7 sensor used in such machines and procedures for lineariz- 

8 ation preparatory to printing with two or more of such 

9 media . 
Q 10 

11 

|i 12 

JjJ 13 BACKGROUND OF THE INVENTION 

i^l 14 

15 For short-run work, particularly for single copies or 

2? 16 a few copies, incremental printers are far faster and more 

17 econoitiical than printing presses. This enormous advantage 

3 18 flows from a totally different set of approaches, tech- 

f 19 niques and processes in the two technologies. 

2 0 Incremental printers form colors through a set of es- 

21 sentially electromechanical procedures, though chemistry 

22 is important in the interaction between inks and printing 

23 media. These procedures are quite different from the fun- 

24 damentally optical/photochemical (and modernly also compu- 
2 5 ter-graphics) operations used in offset printing, 

2 6 Incremental printing does have its own limitations 

2 7 and constraints. Such limitations can be appreciated from 

2 8 a coit^arison of the methods used for defining pixels, and 

2 9 forming colors, in the two very different technologies. 
30 

31 (a) Printing-press technoloov — Traditionally, pix- 

3 2 els of offset negatives and plates are defined and shaded 
3 3 by extremely high -precision — and extremely expensive — 
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1 camera lenses, factory preformed soft-dot screens, and ex- 

2 posure-time controls. 

3 More modernly, as seen for instance in the patents of 

4 Dainippon Screen, offset pixels are in part defined and 

5 shaded by similarly high-precision, expensive electronic 

6 systems. In both of these conventional offset approaches, 

7 i. e. traditional and modern, the overriding technical and 

8 economic philosophy is to endow the professional printshop 

9 with fine precision make-ready apparatus that controls 

10 pixel geometry in a direct geometrical fashion. 

11 The high cost of each make-ready apparatus can be 

12 amortized over make-ready work for many different presses, 

13 many millions of printing impressions, and many years of 

14 service. The equipment which thus defines where and how 

15 much ink will be placed is ordinarily an entirely differ- 

16 ent apparatus from the equipment which thereafter actually 

17 places the ink. 

18 When one more printed copy of the image is desired, 

19 the operators need only rotate the printing drum once more 
2 0 — the colorant placement is already defined by the print- 

21 ing plate. Even if another copy is desired after the 

22 plate has been recycled ( i. e. destroyed) , the identical 

23 colorant placement can be reestablished from the printing 

24 negatives. There is no need to revert to the original 

2 5 information source, whether it was a visible camera-ready 

2 6 master or an electronic image-data computer file. 

27 

2 8 (b) Incremental printing technology — Incremental 

2 9 printing, by comparison, mechanically defines and simulta- 

3 0 neously marks pixels by an ingenious complex of: 

31 

32 ■ moving hardware, 

33 

34 ■ orthogonally moving print meditmi, 
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■ split-millisecond timing^ 

■ an inexpensive consumable component known as a 
^^printhead'' or (in Inkjet printing) ^''pen''^, and 

■ inks specially formulated to be amenable to ejection^ 
flight and deposition without physical contact be- 
tween hardware and medium. 

In incremental printing each act, or operation, of mechan- 
ically defining a particular pixel thus serves — and in- 
stantaneously serves — one and only one application of 
colorant to the medium. 

If another printed copy of the image is desired, the 
entire array of pixels must be mechanically redefined from 
scratch by the same hardware, the only commonality being 
the image-data computer file that defines inf ormationally 
what the electromechanical hardware will later define me- 
chanically. (As noted above, an information source is 
present in offset work too, but not normally consulted for 
each additional printout.) 

Due to the extremely dynamic and transitory nature of 
this pixel -defining and -marking process — and particu- 
larly in view of the relatively humble and inexpensive 
printhead that is at the crux of this process — the re- 
sulting colorimetric tones are subject to significant 
variation. By the same token, however, the entire process 
at each point — being dynamic — is subject to pixel -wise 
control, and this point-by-point control is readily ex- 
ploited to correct or compensate for undesired variation. 

(c) Colorimetric nonlinearity — In particular, the 
variation just mentioned is often manifested in nonline- 
arity of tonal steps — in nominally linear colorimetric 
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1 shadings . Linearity of tonal steps is extremely important 

2 to colorimetric accuracy. 

3 Linearity is important not merely to the precise per- 

4 ceptible shade ( e. q. lightness) of a single subtractive 

5 primary printed alone, but also to the hue and chroma of 

6 all complex shades formed by printing dots of the dif fer- 

7 ent primaries mixed together • Linearity in incremental 

8 printing requires, in effect, either: 
9 

10 (1) a very precise relationship between the size of each 

11 colorant dot and the size of each pixel that such a 

12 dot may occupy — or, alternatively, 

13 

14 (2) an arithmetic adjustment to each input tonal value to 

15 accommodate imprecision in that relationship. 

16 

17 When the dot-to-pixel size relationship is correct, 

18 then a nominally linear geometrical sequence of activated- 

19 pixel fractions produces a similarly linear sequence of 

2 0 actual inking fractions — without any need for arithmetic 

21 adjustment. Accomplishing linearity in this way, however, 

22 would be prohibitively expensive because nonlinearity can 

23 arise from minute tolerances in any of a great number of 

24 operating parameters. 

2 5 These include for example the electronic timing of 

2 6 dot-formation commands, and interactions between the 

2 7 printing medium and the colorant; and, in Inkjet work, 

2 8 distance of inkdrop flight from printhead to printing 

2 9 medium, nozzle size and directionality, heater chamber 

3 0 size, and heater firing energy. The latter four factors 

31 affect inkdrop volume, which in turn influences both dot 

32 size and dot placement. All the parameters mentioned also 

33 directly affect colorant dot coalescence with nearby dots. 
34 
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1 (d) Linearization procedures — Hence in a practi- 

2 cal^ economical sense high-quality printing with incremen- 

3 tal systems and methods requires actual measurement of 

4 tonal-step linearity, and retention of linearization 

5 correction coefficients or the like for use in printing 

6 images thereafter. This kind of correction is known in 

7 the art, and may be effectuated by any of various tech- 

8 niques — some open-loop, others closed-loop. 

9 Some such procedures are centered upon factory meas- 

10 urements for each individual printer, or for an entire 

11 line of printers. Others are based on measurements made 

12 in the field ( i . e . after distribution of the product) , 

13 either automatically by programmed systems in each printer 

14 or by procedures prescribed for performance by hmnan op- 

15 era tors of the equipment — or partly automatic, partly 

16 manual. 

17 All linearization procedures necessarily rely, at 

18 some point in the cumulative history of the overall data, 

19 whether in factory or field, upon printing and measurement 

20 of a test pattern. Such measurement is followed by feed- 

21 back of measured errors as correction signals to color- 

22 adjusting stages in the printing system of the individual 
2 3 printer . 

24 

25 It is well known in this field that results of line- 

2 6 arization are different when a printing system is using 

27 different inks, or different printing media — or both. 

2 8 Therefore, the system linearization procedure must be re- 
29 pea ted whenever a new set of printheads (pens, in Inkjet 

3 0 systems) is placed into service — and also whenever the 
31 print media are changed. 

3 2 The printing and measurement procedures that are 

3 3 needed to accomplish the linearization, described above, 

34 necessarily consume both ink and printing medium — as 
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1 well as time. Since linearization is fundamental to good 

2 image quality, however, these investments of resources are 

3 well spent. 

4 

5 (e) Linearization hardware — In the measurement 

6 phases of linearization, a reliable measuring device is 

7 required. This may be a high-quality colorimeter — for 

8 instance a free-standing one such as mentioned in the 

9 coowned U. S. patent 5,272,518 of Vincent, or a printer- 

10 mounted one such as taught in another coowned patent of 

11 Vincent, U. S. 5,671,059, or in the above-mentioned patent 

12 document of Thomas Baker. 

13 A colorimeter is or can be made direct-reading in 

14 perceptual colorimetric space, such as the well-known 

15 CIELAB space. Such direct perceptual readout is very fa- 

16 vorable, since it is in perceptual terms that a printing 

17 system ideally should be linearized. 

18 Alternatively and much more economically, however, 

19 the measuring device can be a simple densitometer, or even 

20 a relatively crude optical sensor that is custom driven — 

21 and whose output signals are specially interpreted — to 

22 yield values that the Baker document terms ^^pseudodensito- 

23 metric'' measurements. Such a device is especially favora- 

24 ble in a production -printer environment, for measurements 
2 5 to be made in the field after product distribution, be- 

26 cause many or most sophisticated incremental printers al- 

27 ready include such a sensor for other uses. 

2 8 In particular a simple optical sensor — often denom- 

2 9 inated a ^""line sensor'' — is provided for such purposes as 

3 0 pen alignment, and other strictly positional calibrations. 

31 (A representative application of such a sensor is taught 

32 in the Sievert patent document mentioned earlier.) In 

3 3 scanning printers, a line sensor ordinarily is mounted to 
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1 the carriage that holds the printheads and scans them back 

2 and forth across the printing medium. 

3 Actually for such usages a sensor need do little more 

4 than distinguish dark from light. This is accordingly the 

5 type of sensor that a colorimetric calibration module can^ 

6 in effect, inherit from the general operations of an in- 

7 cremental printer. 

8 The line sensor consists of a light source and an 

9 electrooptical detector. The source illuminates the print 

10 medium and whatever marks have been printed upon it, and 

11 the detector produces an electrical signal related to the 

12 light reflected from the medium and those marks . In prac- 

13 tice the source is often a light-emitting diode, or in 

14 better units two such diodes emitting light of different 

15 colors so that the sensor can respond suitably to the sev- 

16 eral subtractive primary colorants used in printing. 
17 

18 (f) Fine linearization with modest equipment — The 

19 challenge then becomes how to infuse such a primitive 

2 0 device with an adequately close approximation to the high- 

21 quality measuring capabilities of a perceptual-reading 

22 colorimeter — or, more precisely, how to do so at minimal 

23 cost and complexity. It is conventional in the art of 

24 incremental printing to meet this challenge by calibrating 
2 5 the sensor itself , in perceptual terms, and storing the 

26 calibration data for use whenever a linearization is to be 

27 performed. 

28 There have been several different overall approaches 

2 9 to providing such a calibration of the sensor. The cali- 

3 0 bration, at least in principle, can be performed either at 

31 the factory or in the field — but factory calibration is 

32 the only prior method which the present inventors know was 

33 actually commercialized: 
34 
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1 If calibration is performed at the factory |. the data 

2 for all media then known are stored in the printer memory 

3 and must be invoked — by media type — before lineariza- 

4 tion for any particular combination of media and inks or 

5 pens. Factory calibration is undesirable for several 

6 reasons that will be taken up shortly. 

7 Commercialization of factory calibration for a line 

8 sensor has occurred in a Hewlett Packard printer /plotter . 

9 In that product the calibration was performed for a sta- 

10 tistically significant number of different sensor units in 

11 production printers, and — from the resulting data — 

12 weighted-mean calibration values were adopted for the 

13 product line as a whole. 

14 In one variant of this sensor- calibration strategy, 

15 different data sets have been acquired for different basic 

16 types of ink: pigment inks and dye inks respectively. In 

17 this case, different calibration values have still been 

18 adopted for the product line as a whole — but these val- 

19 ues have been tabulated separately for the different ink 
2 0 types . 

21 In another variant of the factory sensor-calibration 

22 strategy, different data sets have been acquired for dif- 

23 ferent subpopulations of sensors. Such stibpopulations 

24 arose from tolerances in the light sources, detectors and 

25 geometries of the sensors and diverged significantly in 

26 the conversion factors that they generated through the 
2 7 calibration process. 

2 8 Accordingly in this case different calibration values 

2 9 were adopted for each subpopulation of sensors, rather 

3 0 than for the product line as a whole — but nevertheless 
31 as a matter of convenience, if preferred, all the differ- 
3 2 ent subpopulation sets could be stored in all the prin- 

3 3 ters. This was particularly useful in case the sensor had 
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1 to be changed after a printer has been distributed and is 

2 in the field, i . e. in an end-user's facility. 

3 In any event, the calibration values were then saved 

4 in the printer memory for all the machines in the product 

5 line, and/or in some part of the product line carrying a 

6 particular respective sensor subpopulation , In all cases, 

7 separate calibration numbers were saved for each different 

8 printing medium . 
9 

10 As indicated above, although field calibration of the 

11 sensor has been possible in principle, the present inven- 

12 tors are not aware of any prior commercialization of that 

13 approach. If sensor calibration is performed in the 

14 field, then presumably it is done whenever a new set of 

15 colorants or printheads (or both) is placed in service — 

16 and also whenever a different type of printing medium is 

17 first placed in service. 

18 Since we assume here that the printer is available 

19 for sensor calibration, one field-calibration strategy is 
2 0 to conserve printer memory space by calling for the cali- 

21 bration to be performed shortly before each linearization; 

22 then only one set of media data need be stored at any one 

23 time. 

24 An alternative strategy is to simplify the operation 
2 5 or usage of the machine by storing many sets of media data 

26 — upon acquiring such data in the field — and then call- 

27 ing up a suitable set by media type, as in the factory 

2 8 sensor-calibration case. 
29 

3 0 In any event, after sensor calibration, as noted 

31 above, the system is ready to perfom a linearization for 

3 2 the inks and medium then in use. It has been natural to 

3 3 perform such changes in calibration, like the lineariza- 

34 tion, for each different printing medium because in the 
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1 linearization process — as also mentioned above — the 

2 sensor responded differently to test patterns printed on 

3 different media. In other words, the requirement to cali- 

4 brate the sensor separately for each different printing 

5 mediiim was grounded in the requirement to linearize sepa- 

6 rately for each change of print medium. 
7 

8 (g) Drawbacks in conventional calibration — Un- 

9 fortunately, regardless of which of the above -discussed 

10 approaches and strategies is adopted, several problems 

11 result: 

12 

13 First, when sensor calibration is performed in the 

14 factory any media introduced by the printer manufacturer 

15 after a particular printer has been distributed to an end- 

16 user — and third-party media as well — are absent from 

17 the media-data memory. This is a serious problem because 

18 special provision must then be made for use of such media, 

19 or the media are usable only without proper linearization. 
2 0 Another serious problem is that calibration of a line 

21 sensor is not strictly accurate unless it is performed 

22 using the particular ink sets and printheads that will be 

23 used in the linearization and subsequent printing. 

24 Yet another problem is that memory storage space in 
2 5 the printer must be dedicated to the calibration data. 

2 6 The amount of data, however, is modest and this problem is 

2 7 secondary . 

28 

2 9 Second, if sensor calibration is performed in the 

3 0 field (if in fact this has been done) , while this miti- 

31 gates the problem of third-party and pos tin tr eduction 

32 media — and as well the problem of inaccuracy due to 

3 3 calibration without actual inks and pens to be used — it 

3 4 does introduce other difficulties. Adoption of the first- 
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1 mentioned field-calibration strategy (calibrating a sensor 

2 separately for each linearization) raises the end-user' s 

3 inconvenience and expense: 

4 Recalibration of the sensor after each media change 

5 ( in addition to relinearization of the printing system af- 

6 ter each media change and also in addition to recalibra- 

7 tion of the sensor after each ink-set or pen change) makes 

8 the overall process very time consuming^ and somewhat ex- 

9 pensive in materials cost as well. 

10 This first field-calibration strategy generally dou- 

11 bles the time required for linearization alone. The dual 

12 process also consumes quantities of ink and printing medi- 

13 um^ again roughly doubling the quantities expended for 

14 linearization only. 

15 If instead the second-mentioned field-calibration 

16 strategy (of storing all the different media-data sets) is 

17 adopted, then the problems just discussed are somewhat re- 

18 duced but still important if the user wishes to use sev- 

19 eral different media — particularly trying or switching 

2 0 to new media as they become available. Furthermore the 

21 objectionable cost of dedicated memory space arises again , 

22 as in the factory-calibration case. 
23 

24 Thus from the standpoint of a user of the system, a 

25 separate sensor calibration for each different type of 

26 medium — preliminary to relinearization — is extremely 

27 undesirable. What is desired is some more-efficient way 

28 to prepare for the necessary linearization. 
29 

3 0 (h) Dynamic-range adjustment — For purposes of this 

31 document it is important to distinguish another type of 

32 conventional sensor setting that is sometimes (though not 
3 3 in this document) called '^sensor calibration'', but is a 
34 much lower-level matter and strictly electronic rather 
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1 than related to colorimetry (or even pseudodensitometry) 

2 as such. This is an automatic, routine and rapid proce- 

3 dure that is performed both in the field — i . e. in the 

4 facilities of an end-user — and in the factory. 

5 It is performed before — usually just before — op- 

6 eration of each algorithm that will use the line sensor, 

7 in particular just before a linearization or a sensor cal- 

8 ibration. Its purpose is basically to assure that there 

9 is enough optical signal on the sensor, and thereby enough 

10 electrical signal from the sensor. 

11 This procedure prints a color patch on white paper 

12 for each ink color and calculates optimum electronics set- 

13 tings (gain and offset on the signal amplifiers) for each 

14 color on the given printing mediiom, and for the bare medi- 

15 um; however, as suggested aJDove, this calibration has no 

16 direct relationship with color. For each patch and par- 

17 ticularly for the bare medium, the LED current is raised 

18 until adequate signal appears — most typically eight or 

19 sixteen steps on the analog-to-digital converter C^ADC) 

2 0 — and then until the sensor signal saturates; and then 

21 the current is lowered slightly to establish suitable 

22 dynamic range. 

23 The purpose of this procedure is only to optimize the 

24 ADC dynamic range, and improve the electronic signal- to- 

25 noise ratio, for a given printing medium and ink set. For 

26 purposes of this document, this procedure is not a '^cali- 

27 bration'' and will be called a 'dynamic -range adjustment''. 
28 

29 

3 0 (i) Conclusion — As this discussion suggests, limi- 
31 tations in efficiency of preparing an incremental printer 

3 2 system for use continue to impede achievement of uniformly 

3 3 excellent Inkjet printing that is within the constraints 

34 of acceptability to product buyers, owners and operators. 
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1 Thus important aspects of the technology used in the field 

2 of the invention are amenable to useful refinement. 

3 
4 
5 

6 SUMMARY OF THE DISCLOSURE 

7 

8 The present invention introduces such refinement. In 

9 its preferred embodiments, the present invention has seve- 
10 ral aspects or facets that can be used independently^ al- 
ii though they are preferably employed together to optimize 

12 their benefits. 

13 In preferred embodiments of a first of its facets or 

14 aspects^ the invention is an automatic method of linearis - 

15 ing a color printing system^ for forming images on plural 

16 printing media. The method uses measurements made with an 

17 optical sensor that is onboard the system. 

18 The method includes the step of referring to a single 

19 calibration of the sensor; this calibration is used in 

20 common for substantially all the plural media. This sin- 

21 gle calibration, however, is with respect to exclusively a 

22 single one of the plural media. (In other words, when the 

23 calibration is actually performed , it is performed with 

24 respect to just one of the media.) 

2 5 The method also includes the step of using the sen- 

26 sor, as calibrated by the single common calibration, to 

27 colorimetrically linearize the system for printing with 

28 each of plural colorants on any one medium, of the plural 

29 media. (In other words, the calibration although per- 

3 0 formed with respect to just one printing medium is then 

31 applied more broadly for linearization as to any of the 

32 media.) Yet another step is thereafter maintaining the 

3 3 system as thus linearized for printing on that one medium. 
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1 The foregoing may represent a description or defini- 

2 tion of the first aspect or facet of the invention in its 

3 broadest or most general form. Even as couched in these 

4 broad terms, however, it can be seen that this facet of 

5 the invention importantly advances the art. 

6 In particular, due to explicitly calibrating with re- 

7 spect to just one printing medium rather than many print- 

8 ing media, calibration by the invention consumes only a 

9 small fraction of the time, media and ink used convention- 

10 ally. Therefore in comparison with conventional methods 

11 the invention offers much more favorable economics for 

12 maintaining good color calibration. 
13 

14 Although the first major aspect of the invention thus 

15 significantly advances the art, nevertheless to optimize 

16 enjoyment of its benefits preferably the invention is 

17 practiced in conjunction with certain additional features 

18 or characteristics. In particular, preferably the method 

19 also includes the step of repeating the using and main- 

2 0 taining steps for at least one other medium, of the plural 

21 media — and still more preferably for at least five oth- 

22 ers of the plural media. 

23 Another basic preference is that the method include 

24 the step of, before the using step, performing the single 

25 common calibration using a particular one medium, of all 
2 6 the plural media, which has substantially greatest con- 

27 trast between darkest full inking and unprinted area (this 

2 8 is the medium of broadest gamut) . If this preference is 

2 9 observed then a subsidiary preference is that the perform- 

3 0 ing step include these substeps: 
31 

32 providing a standard test pattern on the partic- 

33 ular one medium, 

34 
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1 employing a colorimeter to find perceptual -space 

2 reflectances of the test pattern, 

3 

4 operating the onboard optical sensor over the 

5 standard test pattern to obtain reflectance 

6 readings of the test pattern, and 

7 

8 tabulating the perceptual -space reflectances of 

9 the test pattern as a function of the on- 
10 board-sensor reflectance readings. 

11 

12 Another basic preference is that the method also in- 

13 elude the step of ^ before the using step, performing the 

14 single common calibration using a particular one medium. 

15 In this basic preference furtheinnore the performing step 

16 includes the same four substeps just enumerated. 

17 If this basic preference is observed, then several 

18 subsidiary preferences apply. One such subsidiary prefer- 

19 ence is that the providing step include printing a ramp 

2 0 with the plural colorants. In this case a still further, 

21 nested, preference is that the ramp-printing comprises 

22 printing with exclusively the plural colorants taken 

2 3 singly. 

24 A second subsidiary preference, within the four-sub- 

25 step basic preference under discussion but particularly 

26 for a sensor that incorporates at least one illiominator ; 

27 is that — to stabilize illumination in the sensor — the 

28 operating substep include operating the at least one illu- 

29 minator continuously before and during measurement of the 

3 0 ramps . 

31 A third subsidiary preference within the four-substep 

32 basic preference is that the operating step include (1) 
3 3 operating a plurality of representative onboard optical 
34 sensors in a plurality of systems; and (2) obtaining a 
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1 statistical measure of results for the plurality of sen- 

2 sors and systems^ to use as the reflectance readings for 

3 calibration of like onboard sensors generally throughout a 

4 product line of the systems. 

5 A fourth subsidiary preference is that the operating 

6 step include (1) operating a particular onboard optical 

7 sensor plural times in a single system, as part of factory 

8 processing of that system; and (2) obtaining a statistical 

9 measure of results for the plurality of operating times, 

10 to use as the reflectance readings for calibration of the 

11 particular onboard optical sensors in the single system. 

12 A fifth subsidiary preference — alternative to the 

13 fourth — is that the operating step include (1) automati- 

14 cally operating the onboard optical sensor in facilities 

15 of an end-user of the system, as part of routine mainte- 

16 nance of that system; and (2) automatically using results 

17 obtained in the end-user facilities as the reflectance 

18 readings for calibration of the end-user*^ s system. 

19 A sixth subsidiary preference is that the operating 
2 0 step include (1) operating a plurality of representative 

21 onboard optical sensors in a plurality of systems; and (2) 

22 obtaining a statistical measure of results for the plural- 

23 ity of sensors and systems, to use as the reflectance 

24 readings. 
25 

26 Another basic preference is that the using step pro- 

2 7 vide CIELAB-space linearity in b* for yellow, and in L* 

2 8 for other colorants. Still another basic preference is 

2 9 that the using step include these substeps: 

30 

31 with each of the plural colorants respectively, 

32 printing a ramp of tonal patches at nomi- 

33 nally specified tonal levels, 

34 
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1 using the calibrated onboard sensor to colori- 

2 metrically measure the ramps to determine 

3 actual tonal levels^ and 

4 

5 for each of the plural colorants respectively, 

6 determining corrections for subsequent ap- 

7 plication at each nominally specified tonal 

8 level to linearize actually printed tonal 

9 levels . 
10 

11 If this basic preference is in use, then some subsidiary 

12 or auxiliary preferences also are applicable. 

13 In one such subsidiary preference, the using step 

14 includes measuring an unprinted area of the first medium 

15 as a reference white point for the linearizing. In anoth- 

16 er, the ramp-printing substep includes printing each re- 

17 spective ramp with negligible hue-angle variation along 

18 the ramp. 

19 In still another such subsidiary preference — par- 

20 ticularly for a sensor that incorporates at least one il- 

21 luminator — to stabilize illumination in the sensor, the 

22 using substep comprises operating the at least one illiimi- 

23 nator continuously before and during measurement of the 

24 ramps . 

25 One further basic preference is that the said single 

26 calibration include plural subcalibrations for plural ink 

27 types respectively. In this case it is further preferred 

28 that the plural ink types respectively include pigment 

2 9 inks and dye inks . 
30 

31 
32 

3 3 In preferred embodiments of its second major indepen- 
34 dent facet or aspect, the invention is an automatic method 
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1 of linearizing and then using a color printing system, to 

2 form a color image on any one of plural printing media. 

3 The method is based upon measurements made with an optical 

4 sensor that is onboard the system. 

5 The method includes the step of referring to a single 

6 calibration of the sensor. The single calibration is with 

7 respect to exclusively a single one of the plural media — 

8 but is used in common for substantially all the plural 

9 media . 

10 The method includes the step of using the sensor^ as 

11 calibrated by the single common calibration, to color imet- 

12 rically linearize the system for printing with each of 

13 plural colorants on any one medium, of the plural media. 

14 Another included step is thereafter using the system with- 

15 out further sensor calibration to form a properly colori- 

16 metrically linearized image on any different one medium, 

17 of the plural media. 

18 The foregoing may represent a description or defini- 

19 tion of the second aspect or facet of the invention in its 
2 0 broadest or most general form. Even as couched in these 

21 broad terms, however, it can be seen that this facet of 

22 the invention importantly advances the art. 

2 3 In particular, the advantage arising from this facet 

24 of the invention is complementary to the advancement noted 

25 above for the first aspect of the invention. For this 

2 6 second aspect, the benefits of economical calibration are 

27 extended from the context of the calibration procedure it- 

2 8 self to the context of using a printer system to produce 

2 9 images of fine color quality. 
30 

31 Although the second major aspect of the invention 

32 thus significantly advances the art, nevertheless to 

33 optimize enjoyment of its benefits preferably the inven- 

3 4 tion is practiced in conjunction with certain additional 
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1 features or characteristics. In particular^ of all the 

2 plural media, preferably the single one has greatest 

3 contrast between darkest full inking and unprinted area. 

4 Another preference is particularly for use if the 

5 sensor incorporates at least one illuminator. In this 

6 preferred case, to stabilize illumination in the sensor 

7 the using substep includes operating the at least one il- 

8 luminator continuously before and during measurement of 

9 the ramps . 

10 Another preference is that the method further include 

11 the step of, before the using step, performing a dynamic- 

12 range adjustment. 

13 
14 
15 

16 In preferred embodiments of its third major independ- 

17 ent facet or aspect, the invention is a printer. The 

18 printer is for forming images on plural printing media, 

19 and includes an optical sensor that is onboard the system . 
2 0 The printer also includes first processor portions 

21 for perfoanaing a first program. The program operates the 

22 printer and sensor to develop a single calibration of the 

23 sensor. This calibration is with respect to exclusively a 

24 single one of such plural media, but is for use in common 

25 with siibstantially all of such plural media. 

26 (In the accompanying claims generally the term "such" 

27 is used — instead of ^'said'' or "the" — in the bodies of 
2 8 the claims, when reciting elements of the claimed inven- 

2 9 tion , for referring back to features which are introduced 

3 0 in preamble as part of the context or environment of the 

31 claimed invention. The purpose of this convention is to 

32 aid in even more distinctly and emphatically pointing out 
3 3 which features are elements of the claimed invention, and 
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1 which are parts of its context — and thereby to more par- 

2 ticularly claim the invention . ) 

3 

4 Also included are second processor portions for per- 

5 forming a second program. This program operates the prin- 

6 ter, and the sensor as calibrated by the single common 

7 calibration^ to colorimetrically linearize the system for 

8 printing with each of plural colorants on any one medium, 

9 of such plural media. 

10 In addition the printer includes a memory for there- 

11 after maintaining linearization data, for the printer as 

12 thus linearized, for printing on said any one medium, of 

13 the plural media. It will be understood that these reci- 

14 tations mean that the single common sensor calibration 

15 serves in linearization for printing on any one, not just 

16 some particular specially selected one, of the plural 

17 media. 

18 The foregoing may represent a description or defini- 

19 tion of the third aspect or facet of the invention in its 
2 0 broadest or most general form. Even as couched in these 

21 broad terms, however, it can be seen that this facet of 

22 the invention importantly advances the art. 

23 In particular, this facet of the invention is in es- 

24 sence a hardware manifestation that is particularly advan- 

25 tageous for calibration of the sensor in the field. As 

2 6 explained earlier, a benefit of using just one sensor cal- 

27 ibration for all media is that field calibration is not 

2 8 necessary ; however, it may still be desirable in event the 

2 9 sensor must be changed, or if the system is to be used 

3 0 with newly introduced inks. 

31 In the latter case, field calibration avoids the 

3 2 necessity of downloading information into the printer from 

3 3 the Worldwide Web or otherwise. Benefits of this third 
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1 aspect of the invention essentially parallel those of the 

2 first and second aspects discussed earlier. 

3 
4 
5 

6 In preferred embodiments of its fourth major indepen- 

7 dent facet or aspect, the invention is an automatic method 

8 of calibrating an optical sensor and using the sensor to 

9 linearize a color printing system that forms images on 

10 plural printing media. This method includes the step of 

11 deriving a single sensor calibration from ideal properties 

12 of color inks, without making any optical measurement us- 

13 ing the sensor. 

14 It also includes the step of referring to the derived 

15 single calibration, used in common for substantially all 

16 the plural media; and furthermore the step of using the 

17 sensor as calibrated by the single common calibration to 

18 colorimetrically linearize the system for printing with 

19 each of plural colorants on any one medium, of the plural 
2 0 media . 

21 Another step is thereafter maintaining the system, as 

22 thus linearized, for printing on the one medium. The 

23 foregoing may represent a description or definition of the 

24 fourth aspect or facet of the invention in its broadest or 
2 5 most general form. 

26 Even as couched in these broad terms, however, it can 

27 be seen that this facet of the invention importantly ad- 

28 vances the art. In particular, this facet of the inven- 

2 9 tion offers an extremely rapid and generalized way to get 

3 0 sensor-calibration data without any of the drawbacks of 
31 resorting to measurements. 

32 

33 Although the fourth major aspect of the invention 

34 thus significantly advances the art, nevertheless to 
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1 optimize enjoyment of its benefits preferably the inven- 

2 tion is practiced in conjunction with certain additional 

3 features or characteristics. In particular, the preferen- 

4 ces introduced above as to each aspect of the invention 

5 are applicable to all the other facets too, including this 

6 fourth aspect. 
7 

8 

9 All of the foregoing operational principles and 

10 advantages of the present invention will be more fully 

11 appreciated upon consideration of the following detailed 

12 description, with reference to the appended drawings, of 

13 which: 
14 

15 
16 

17 BRIEF DESCRIPTION OF THE DRAWINGS 

18 

19 Fig. 1 is a graph of local contrast ratio for magenta 

2 0 ink, using a Panasonic® blue LED and a Hewlett Packard 

21 amber LED (as well as a TAOS® TSL251 receptor) ; 

22 Fig. 2 is a like graph but using instead two Hewlett 
2 3 Packard LEDs — one bluish-green and another red-orange 
24 (and the TAOS unit too) ; 

2 5 Fig. 3 is a group of four graphs showing perceptual- 

26 color- space parameters corresponding to absolute and local 

2 7 contrast ratios, as derived on the basis of ideal inks — 

2 8 without measurement, in keeping with the above-mentioned 
29 fourth main facet of the invention; and 

3 0 Fig. 4 is a block diagram, highly schematic, repre- 

31 sen ting hardware (including programmed circuitry) in a 

32 preferred embodiment of the invention. 

33 
34 
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1 DETAILED DESCRIPTION 

2 OF THE PREFERRED EMBODIMENTS 

3 
4 

5 1. SENSOR CALIBRATION FOR ALL MEDIA IN COMMON 

6 

7 In prior incremental -printer products and procedures, 

8 as discussed in the "^Background" section of this document, 

9 it has been conventional to use a line sensor and to pro- 

10 vide a separate calibration of that sensor for use with 

11 each different printing medium. The present inventors are 

12 aware of prior Hewlett Packard commercial products that 

13 operated in this way, based upon factorv calibrations com- 

14 mon to a whole product line — and saved in the printer 

1 5 memory . 

The media-dependent sensor calibrations (i_; — e^ ap- 

17 propriate to particular media respectively) were to be 

18 invoked in preparation for each relinearization of the 

19 printing system — and this was possible only for media 

2 0 known to the printer manufacturer at the time of product 

21 distribution. These calibrations were also limited in 

2 2 accuracy because of the manufacturing tolerances in ink 

23 sets and printheads actually placed in service in the 

24 field. 

25 The present invention eliminates both these handicaps 
2 6 — the limitation to media known and recognized in advance 
27 by the printer manufacturer, and also the ink-set/print- 

2 8 head accuracy limitation. This is accomplished by cali- 

2 9 bra ting in the field. 
30 

31 If any commercial products previously employed field 

3 2 line-sensor calibration that was media dependent, the in- 
3 3 vention also eliminates the relatively onerous dual proce- 
34 dure (requirement to perform both sensor recalibration and 
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1 relinearization) which would have been required in such 

2 products whenever linearization was needed due to media 

3 change. This is accomplished by relying upon one single^ 

4 media- independent sensor calibration for all media. 

5 

6 As discussed in the earlier passage about the fourth 

7 aspect of the invention, and in subsection 8 below, an 

8 approximate calibration of the sensor can be obtained with 

9 no measurements at all. Preferred embodiments of the in- 

10 vention, however, do include actual physical measurements 

11 as described in all the other parts of this document. 

12 The invention flows from recognition and confirmation 

13 that sensor calibration is relative, and that a calibra- 

14 tion actually established using just one suitable printing 

15 medium is applicable to sensor use for other printing me- 

16 dia. (Repetition of just the linearization for each medi- 

17 ura remains a requirement, and is readily acceptable in 

18 comparison with the dual procedure discussed above.) 

19 What constitutes a suitable medium for such a one- 

2 0 time calibration is straightforward. The medium ideally 

21 is the lightest-colored one of all printing media which an 

22 operator intends to use — thereby establishing for the 

23 sensor a calibrated operating range that encoir^asses all 

24 tones, or very nearly all tones, to be encountered in op- 
2 5 eration with all those media. 

26 

27 Requirements for sensor calibration flow from those 

2 8 for the linearization in which the sensor will be used. 

2 9 Linearization in preferred embodiments provides linearity 

3 0 in the L* dimension for the K, C and M ramps, and lineari- 

31 ty in b* for the Y ramp. 

32 This being so, the question becomes what the rela- 
3 3 tionship is between the tone-ramp linearization and the 
34 reference white that is implicitly involved. Going back 
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1 to the basic L*a*b* formulas, it can be clearly seen that 

2 if there are two different reference whites, in tristimu- 

3 lus coordinates (Xo/Yq^Zq) and (Xi,Yi,Zi) there are also two 

4 corresponding L*a*b* systems . 

5 To pass from one system to the other, the X,Y,Z sys- 

6 tern can be used to connect the two. This can be done by 

7 back-solving the equations for each case. 

8 To instead demonstrate that if a tone ramp is line- 

9 arized in one system it is also linearized in the other, 

10 an effective algebraic strategy is to characterize small 

11 increments AI«/ Aa, Ab in the L*a*b* system in terms of 

12 the corresponding X,Y,Z variables. When this is done and 

13 the X,Y,Z expressions worked through for L* in particular, 

14 it will be found that a change in the reference white only 

15 scales the L* values by a constant. 

16 This in turn implies that in the L* dimension line- 

17 arization can be performed independently of the reference 

18 white that is used — i. e. , the linearization is media - 

19 independent . This clearly indicates that L* is a desira- 
2 0 ble parameter for use in linearizing a color ramp. 

21 One meaningful reason to object to using L* is that 

22 it has a smaller range, as compared with a* or b*, for a 

23 particular colorant. This is in fact importantly so in 

24 the case of yellow. 

2 5 Although the proof is somewhat more complicated and 

2 6 less strictly accurate, a closely analogous scaling-by-a- 

27 constant and media independence can be shown for the a* 

28 and b* dimensions. Based on such a demonstration, pre- 

2 9 f erred embodiments of the present invention use b* for 

3 0 linearization of yellow. 

31 These conclusions have been stated in terms of line- 

3 2 arization. As suggested above, however, the same conclu- 
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1 sions carry over to practical requirements for line-sensor 

2 calibration. 

3 
4 

5 2. DYNAMIC CLOSED-LOOP COLOR CALIBRATION 

6 

7 For purposes of this document^ to avoid confusion 

8 with the subject of the present patent document — namely, 

9 ^^calibration" of the line sensor — the phrase '^color cal- 

10 ibration" is limited to colorimetric linearization of an 

11 incremental printing system. This in turn, as suggested 

12 earlier, means developing and applying transfer functions 

13 to each of the printer's continuous- tone planes (typically 

14 CMYKcm) independently. The result is consistent print- to- 

15 print and printer-to-printer color. 

16 Linearization that can be performed for any printing 

17 medium is essential for a printer manufacturer. It ena- 

18 bles optimum image quality when a printer introduced by 

19 that manufacturer is used with third-party media — as 

2 0 well as with new, postintr eduction media offered by the 

21 same manufacturer. 

22 Sensor calibration in turn is critical to a good 

23 linearization, and the invention makes possible such cal- 

2 4 ibration that is far more practical than heretofore. This 

2 5 invention is best incorporated into a closed-loop, dynamic 

2 6 form of overall color calibration and linearization. 
27 In operation of preferred embodiments, the printer 

2 8 prints a test pattern — sometimes called a target". The 
29 target is printed using a first, preliminary linearization 

3 0 and representatively contains four or six ramps of pref- 

31 erably sixteen patches of different amounts of ink, usual- 

32 ly including one at maximum density. 

3 3 One preferred form of pattern layout and scan proce- 

3 4 dure is taught in the patent document of Paul Soler et al . 
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1 mentioned earlier; for present purposes, however, the 

2 intense concern as to stability reflected in that document 

3 is typically not required. Another preferred form of pat- 

4 tern layout and scan procedure is introduced in the first 

5 of the two earlier-mentioned patent documents of Francesc 

6 Subirada et al. 

7 Each of the ramps is printed using a different one of 

8 the subtractive primary colorants available in the system. 

9 Refining the linearization for the particular combination 

10 of ink and printing medium, however, first requires a cal- 

11 ibration of the line sensor . 
12 

13 

14 3. LINE-SENSOR CALIBRATION 

15 

16 There are fundamentally three ways in which this can 

17 be provided using the present invention: 

18 

19 "a sensor calibration for the entire product line can 

2 0 be developed at the factory, measuring the response 

21 of a sizable number of the sensors and finding a sui- 

2 2 table representative relation — such as a mean, or a 

2 3 weighted mean, etc. — and storing the sensor cali- 

24 bration data in a nonvolatile memory of each printer 

2 5 in the line; 
26 

2 7 "a sensor calibration for the particular sensor in 

2 8 each individual printer can be developed at the fac- 

2 9 tory, measuring the response of that sensor only — 

3 0 and again storing calibration information in a mem- 
31 ory, but only a memory of that individual printer; or 
32 

3 3 "a sensor calibration for the particular sensor can be 

34 developed in the field, most typically in the end- 
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1 user' s facility — and ideally through operation of 

2 an automatic procedure programmed into the printer, 

3 or into an associated computer or raster-image proc- 

4 essor (^^RIP") . 

5 

6 If desired, a particular printer may be provided with a 

7 sensor calibration through either of the first two methods 

8 but also with the necessary programming to update the cal- 

9 ibration by the third method, from time to time as the 

10 system ages — most typically over a period of years — 

11 and the sensor may be expected to drift in its response. 

12 These methods are also subject to the variants men- 

13 tioned in subsection (f) of the earlier '^BACKGROUND OF THE 

14 INVENTION section of this document. Those relate to cal- 
ls ibrations using different ink types or different sensor 

16 subpopulations . 

17 In any of these methods, what is contributed by the 

18 present invention is relief from the need to calibrate, 

19 and store calibration data, for each of the possible print 
2 0 media that is to be used in the machine. To the contrary, 

21 according to the invention it is necessary to perform a 

22 calibration for only just one printing medium (ideally a 
2 3 carefully selected one, as noted earlier) . 

24 

2 5 In simplest mechanical terms, the sensor calibration 

2 6 measurements — wherever and whenever they are made — 

27 consist of scanning the arrays of patches and performing 

2 8 computations on the signals from the sensor. These com- 

2 9 putations derive needed transfer -function coefficients 

3 0 that characterize the sensor itself. 

31 These measurements and consequent computations are 

3 2 closely analogous to those that make up the system line- 

3 3 arization which then follows. There are, however, impor- 

34 tant differences, and constraints: 
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1 ■ linearization must be performed for each combination 

2 of ink and printing medium; 

3 

4 ■ sensor calibration, according to the present inven- 

5 tion, must be performed for each ink set but not for 

6 each printing medium; 

7 

8 ■ the linearization process requires that the sensor 

9 calibration be done first; 

10 

11 ■ the sensor calibration process requires an already 

12 linearized^ printed test pattern; 

13 

14 ■ such a test pattern cannot be printed, on the partic- 

15 ular printer to be linearized, before the sensor cal- 

16 ibration is done. 

17 

18 Therefore it is necessary to use a previously printed test 

19 pattern — made either with some other printer that was 

2 0 well linearized at the time, or with the same printer ear- 

21 lier when it was linearized. For instance, a preprinted 

2 2 test pattern may be supplied from the factory, with the 

2 3 printer; however, such targets may be subject to degrada- 

24 tion, particularly if not kept sealed away from air and 

2 5 out of the light. 

2 6 If the sensor response itself is linear, then it can 

2 7 be shown mathematically that a sensor calibration made 

2 8 using one print medium is good for all other print media 

2 9 of equal or lesser lightness. In practice, however, even 

3 0 if the sensor response itself is not linear — in particu- 

31 lar, if the output is equal to the input raised to some 

32 power that is not equal to one (unity) — then such non- 
33 linearity can be subsumed within the sensor calibration. 
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1 This is true only if the nonlinearity is not overly 

2 strong, e . g. if a nonunity exponent is close to unity. 

3 If a stronger or more complicated nonlinearity is present, 

4 it may interfere with orderly intearpolation . 

5 

6 More specifically, whether for linearization or for 

7 sensor calibration, the line-sensor readings are first 

8 used to find normalized values . The present inventors use 

9 the terms absolute contrast ratio'' (^^ACR") for the norma— 

10 lized black-ink ramp measurement signals, and ^""local con- 

11 trast ratio'' (^^LCR") for the chromatic ink ramps. 

12 Derivation of ACR and LCR is shown in sections 6 and 

13 7 below. (These variable names are used in the present 

14 document somewhat differently than in some of the other 

15 patent documents mentioned earlier.) 
16 

17 If it is sensor calibration that is being performed, 

18 then nothing has just been printed; rather, the sensor has 

19 measured known-linear patterns of known tonal values. The 
2 0 ACR and LCR (normalized sensor readings, as above) are 

21 compared with known correct perceptual readings of a 

22 CIELAB colorimeter. 

2 3 Again, the departures are effectively inverted to 

24 develop conversion factors (or terms) . The system can 

25 then rely upon sensor readings as equivalent to CIELAB 

2 6 values, when performing linearization as described below. 
2 7 Preferably the conversion numbers are stored in the 

2 8 printer memory in the form of lookup tables, for quick ap- 

2 9 plication to input tonal values in each plane — most usu- 

3 0 ally with one interpolation stage. If desired, however, 
31 it is possible to instead develop a correction function , 

3 2 for instance using spline techniques, for use in calculat- 

3 3 ing CIELAB values from the sensor-signal normalized ACR 

3 4 and LCR nximbers . 
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1 Once again, according to the present invention^ just 

2 one sensor calibration does suffice for all media. On the 

3 other hand, regardless of which form of correction is 

4 preferred, it is helpful to have one set of sensor-cali- 

5 bration values for each type of ink. 

6 In principle a single calibration may be made to suf- 

7 fice for all inks as well. For future convenience, howev- 

8 er, because the character of inks to be introduced in the 

9 future cannot be foretold as well as the character of me- 

10 dia to be introduced in the future — and because interac- 

11 tion of the sensor with different inks is usually somewhat 

12 more complex than with different media — it is not ad- 

13 vised to attempt such a strategy. 
14 

15 

16 4. SYSTEM LINEARIZATION 

17 

18 On the other hand, if it is linearization that is 

19 being performed, the ACR and LCR numbers from the sensor 

2 0 are translated into perceptual (preferably CIELAB) values. 

21 True colorimetric linearity of the printed test patterns 

2 2 can then be evaluated, 

2 3 Measured departures from desired linearity are next 

24 in effect inverted to develop linearizing adjustments for 

25 application to tonal values expressed in image data. When 
2 6 these adjustments are applied, the printing system thereby 
27 is actually instructed to produce tonal values slightly 

2 8 higher or lower than truly desired. 

2 9 In other words, in effect deliberate errors are in- 

3 0 troduced. This is done, however, in the knowledge that 
31 these deliberate errors and the nonlinearities present in 
3 2 the system will counteract one another, thereby producing 
3 3 correct tones. 
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1 The linearization includes generation of, most pref- 

2 erably, nine-bit transfer functions and also error-diffu- 

3 sion thresholds (analogously to the procedure introduced 

4 in the patent document of Bookman and Li mentioned earli- 

5 er) . These intermediates are applied to color signals 

6 just before or during halftoning — below the printer-lan- 

7 guage level, and invisible to conventional operations in 

8 that language. 

9 This last point is true whether the printer- language 

10 pipeline in use is for instance PostScript®, HPGL or RTL. 

11 Accordingly the same linearization can be used in any such 

12 printer language pipeline, a capability which represents 

13 another favorable innovation. 

14 A separate linearization should be performed for each 

15 combination of ink and media. It is not suggested that 

16 only one linearization can suffice for all media, or for 

17 all inks. 

18 Starting without a prelinearized system, linearity 

19 measurements suggest a mean nonlinearity of roughly 3 dE, 
2 0 and maximiam of about 7 dE. (The units "dE" represent a 

21 well-known measure of small distances in three-dimensional 

22 perceptual color space.) Starting instead from a preline- 
2 3 arized system, these values can be reduced to approximate- 
24 ly 1 dE average, and 2 to 3 dE maximum. 

25 
26 

2 7 5, FURTHER LINE-SENSOR CALIBRATION DETAILS 

28 

29 Practice of the present invention does not require 

3 0 any deep familiarity with theoretical analysis of measure- 

31 ment systems, or with colorimetric principles, although 

32 the present inventors have performed such analysis and are 
3 3 familiar with those principles. One particularly advanta- 
34 geous characteristic of the invention is that it can be 
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1 straightforwardly practiced on the basis of only the gen- 

2 eral descriptions presented in this document. 

3 Some generalities found through the inventors' analy- 

4 sis and system design, and useful in obtaining perspective 

5 for practice of the invention, are these: 
6 

7 ■ The line sensor can be characterized as a linear 

8 system. 

9 This result is of central importance to the 

10 present invention, for it is what enables sensor cal- 

11 ibration with just one single printing medium to 

12 serve for all media. As suggested above, small or 

13 smoothly varying nonlinearities in the sensor re- 

14 sponse are tolerable — and in fact simply become 

15 part of the overall variation for which the sensor 

16 calibration accounts. 
17 

18 ■ The typical sensor is a broadband device. 

19 Preferred sensors for use in this field are sen- 
2 0 sitive over the entire visible spectrum, though not 

21 uniformly. A representative line sensor in a printer 

22 has maximum response in the infrared. 
23 

24 ■ Economical sensor illuminants are ordinarily LEDs, 

25 currently a pair: one amber, one blue. 

2 6 These sources together provide an adequate ap- 

27 proximation to white light — for maximum response in 

2 8 sensing the relative tonal values of the subtractive- 

2 9 primary and black inks ordinarily used in incremental 

3 0 printing. Operating the two sources simultaneously 

31 is useful for best stability. 

32 Such simultaneous operation, however, does re- 

3 3 quire high-quality electronics (including an analog- 

34 to-digital conversion stage with very high dynamic 
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range) . This requirement arises because most meas- 
urements are made on a high signal pedestal — due to 
the presence of light from both sources. 

That condition obtains even when just one source 
is providing critical illumination for measurement of 
a particular colorant. (Further details appear in 
the above-mentioned patent document of Pau Soler et 
al^) 

■ Equalization of the two LEDs is very desirable. 

The idea of '"equalization" means that a calibra- 
tion is performed to establish a "'virtual'' third LED 
that has roughly constant optical output power along 
its range of supply currents. Here is an example: 

LED current LED optical power (mW) 
(mA) 
10 
20 
30 

gain (mW/mA) : 
offset (mW) : 

This tabulation shows that if the same supply current 
is applied to both LEDS, different parts of the spec- 
trum have different optical power — and different 
power gains per unit of added supply current. 

The differing power responses of the two LEDs 
makes the unbalance, as between the two spectral re- 
gions, different for each current level. Therefore 
it is preferable not to apply the same current to 
both LEDs; instead they should receive different cur- 
rent flows. 

, ^« 35 p. Lippman / PD-60990045 xHPZ-42 

Subirada et al. / July 19 , 2001 -^^ ^' ^^^^ 



blue 


amber 
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25 


60 


10 


70 


100 


15 


115 


4 


0.5 


4. 


-20 


0 
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1 It is possible to calculate what current to ap- 

2 ply to both LEDS to make the power on both spectra 

3 grow at the same rate. The less powerful (the amber) 

4 LED can be taken as a reference. 

5 To give the more powerful (blue) LED the same 

6 output-power sensitivity, whatever current- growth 

7 steps are needed for the amber are scaled down for 

8 the blue. The current growth is lowered in propor- 

9 tion to the ratio of the two gains — i. e. in pro- 

10 portion to 4/0.5 = 8* 

11 For example, suppose a current step of 10 mA 

12 (leading to a 5 mW power step) is needed in amber. 

13 The blue LED current instead can step by only 10/8 = 

14 1.25 mA (also leading to a 5 mW power step, matching 

15 the amber) . 

16 In addition it is also desirable to select parts 

17 of the operating ranges (particularly including 

18 starting offset points) of both LEDs over which the 

19 current and corresponding power values retain about 

2 0 the same (or other compatible) relationships. As one 

21 exemplary solution, the current and power may be: 
22 

23 virtual LED amber LED blue LED 

24 inA mW mA mW mA mW 

25 10 13 10 5 7 8 

26 20 23 20 10 BH 13 

27 30 33 30 15 9^ 18. 
28 

2 9 A proportional part (allowing for the different start 

3 0 values) of the current passing through the amber unit 
31 can be tapped off for the blue. Here the gain is 1 

3 2 mW/mA for the virtual LED. 

33 
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Adequate sensor stabilization requires accommodating 
warmup of the LEDs. 

In particular, the illumination they emit — and 
accordingly the reflection from the test pattern, and 
the corresponding signal generated by the sensor — 
varies with temperature. Temperature affects both 
the overall light-emission efficiency and the spec- 
tral distribution (including the peak wavelength) of 
each diode. To bring these factors under control, 
before beginning actual measurements the LEDs should 
be operated for a period of time necessary to stabi- 
lize their temperature. 



6. DEFINITION AND DETERMINATION OF A. C. R. VALUES 

The previously mentioned ACR and LCR, as these are 
used in the present document, are useful intermediate 
variables that conveniently relate raw data from the line 
sensor to perceptual measures of tonal values in the test- 
pattern ramp for each colorant plane. As suggested earli- 
er, these perceptual measures may be acquired for use to 
indicate the ability of either: 

■ the sensor, to read a standard, correct test pattern 
accurately — in perceptual terms; or 

■ the printer, to make a correct test pattern. 

In either case, the ACR is a normalized form of the 
raw data readings from the sensor. For a reference 
^^white'^ (for example, the bare unprinted printing medium) , 
the maximxam ACR will be that of the medium itself (100% 
ACR) and the minimum will occur when all power for all 
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1 wavelengths in the illumination is absorbed (0% ACR) by an 

2 absolute black colorant. 

3 ACR accordingly can be defined, for a particular col- 

4 or tone measured by the sensor, as a quotient of reflected 

5 light power Pabs vs. the incident power Pinc — again, tak- 

6 ing into account all the desired spectrum for a wavelength 

7 range : 

8 ACR = ^ . 

P 

9 ^INC 

10 For normalization purposes, however, the power reflected 

11 from a particular color tone patch should first be correc- 

12 ted for an offset that is due to the sensor yielding a 

13 nonzero reading when the light reaching it can be assumed 

14 to be zero: 
15 

16 Erefl = Epatch " £k- 

17 

18 The incident power R^^c is ^ special case of this same ex- 

19 pression, obtained when there is no printed patch, so that 
2 0 reflection is maximum — the value Pmed received from the 
21 bare unprinted printing medium: 

22 

2 3 2iNc = 5med ~ Ek« 

24 

2 5 Here P^nc is represented simply as the maximum possible 

26 value of reflected light power, which is to say the dif- 

2 7 ference between the sensor readings of power reflected 

2 8 from the print medium Pmed and from an absolute black col- 

2 9 orant Pk- 

3 0 Inserting into the expression given above for the 

31 ACR: 

32 j^cR = El^^cHjZ^^ 

3 3 '^MED ^ K 
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1 Taking the sensor measurement signals M as proportional 

2 (within small nonlinear! ties as mentioned earlier) to the 

3 power values P^. the ACR can therefore be expressed direct- 

4 ly in terms of the sensor signals M. 

5 The various proportionality factors implicit in the 

6 relationship between M and P — such as in particular the 

7 effective area over which the light is collected through 

8 the sensor field of view — cancel out, leaving the con- 

9 elusion that ACR can be measured directly for any triad of 

10 light reflected from (1) a particular patch, (2) paper 

11 ''white'' and (3) absolute black: 



12 
13 
14 



j^CR = ^^^^ ^ 



15 As a practical matter, however, the line-sensor meas- 

16 urement signals M indicated here are advantageously taken 

17 making several san5>les of the sensor signal — ordinarily 

18 on the order of ten samples — and averaging them. As 

19 suggested earlier, it is important that the average sat- 
2 0 isfy thermal-stabilization criteria. 

21 
22 

23 7. DEFINITION AND DETERMINATION OF L. C. R. VALUES 

24 

2 5 The concept of ACR, as shown in the previous section, 

2 6 is analogous to having an absolute-referenced measurement. 

27 Such a derivation is directly applicable to black, because 

2 8 black always absorbs almost all of the visible spectrum, 
29 and in particular absorbs all the LED power independently 

3 0 of the spectral balance of that power. 

31 This assuit^tion fails for the chromatic colorants 

3 2 CMY, whose absorption depends strongly on the spectral 

3 3 balance of the LEDs . Referred to the absorption of abso- 

3 4 lute black, the value varies depending on the spectrum of 
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1 the diodes, and so disrupts the line-sensor independence 

2 that is pursued here. 

3 There cannot exist one lookup table that relates sen- 

4 sor readings to CIELAB for all possible sensors . The de- 

5 pendence, moreover, can be affected by spectral variation 

6 among LEDs of different standard types (Fig. 1) and some 

7 alternative types (Fig. 2) . 

8 The illustrations exhibit variation in the 100%-of- 

9 magenta ACR, amounting to a divergence of roughly eight 

10 percent in this concrete case. Self -warming spectral 

11 variation still further complicates the response for the 

12 chromatic color inks. 

13 For robustness relative to this LED spectral varia- 

14 tion for all the colors other than black, LCR can be de- 

15 fined analogously to ACR but taking as reference 100% of 

16 the ink color rather than 100% of absolute black. Thus 

17 with Ifc MAX the maximum sensor response for color-plane ^^N'' 
IS ( e. g. one of the chromatic colorants CMY, or in some sys- 
19 tems the dilute colorants cm, etc.), the LCR is: 

20 

^ PATCH ~~ ^NMAX 

21 LCR = 



22 

2 3 It can be shown that the ACR measurements are the 

24 fundamental basis for dynamic closed-loop color, using the 

25 invention, while LCR is just a derivative from it. Famil- 
2 6 iarity with the derivation, however, is not necessary to 
27 effective practice of the present invention. The relation 
2 8 can be written: 



29 

30 ^CR^^^j,^ = 1 - • 

31 

3 2 In this expression, ACR^ctuai is found from the previous ex- 

3 3 pression for ACR in terms of Spatch or Mpatch — but evaluated 

34 for an intermediate tonal value of one of the chromatic- 
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1 color inks — while ACRjaxu^ is seen in the previous ex- 

2 pression for ACR, evaluated for 100% of that color. 

3 
4 

5 8. SENSOR CALIBRATION TABLES FROM IDEAL INKS 

6 

7 Procedures for sensor calibration based on actual 

8 measurements have been described above ^ particularly in 

9 subsections 1, 3, and 5 through 7 of this Detailed De- 

10 scription. Those procedures are particularly useful in 

11 obtaining sensor- to-CIELAB conversions that are fully 

12 adapted to the spectral behavior of actual inks, as dis- 

13 tinguished from ideal colorants. 

14 Achieving such a full adaptation to real -world inks 

15 is a main reason for preparing tables specific to each 

16 ink. It is possible, however, to establish fairly worka- 

17 ble sensor-to-' LAB conversions based on ideal relation- 

18 ships. 

19 The idea is to establish a relationship between the 
2 0 ACR and LCR variables and the L*a*b* system. For a par- 
21 ticular primary ( e. g. magenta) , if a path is defined 

2 2 from that color to white, then it is possible to map, for 

2 3 that specific color, a relationship between the ACR and 

24 the L*a*b* of that color ramp. 

25 As an example, this task has been performed using 

2 6 Adobe Photoshop® graphics program. Color ramps were de- 

2 7 fined going from white to each primary KCMY, and then the 

28 L*a*b* ^^measurements'' were taken for each ramp patch using 

2 9 the same Photoshop program. 

3 0 The resulting values constitute the sensor- to-LAB ta- 

31 bles for each color. Data (Fig. 3) in these tabulations, 

32 although of course inaccurate because they do not account 
3 3 at all for true spectral properties of actual inks, are 

3 4 usable. 
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1 

2 9. HARDWARE AND PROGRAM IMPLEMENTATION 

3 

4 As the inven-tion is amenable to implementation in^ or 

5 as, any one of a very great number of different printer 

6 models of many different manufacturers, little purpose 

7 would be served by illustrating a representative such 

8 printer. If of interest, however, such a printer and some 

9 of its prominent operating subsystems can be seen illus- 

10 trated in several other patent documents of the assignee, 

11 Hewlett Packard — such as for exainple the previously men- 

12 tioned document of Thomas Baker, which particularly illus- 

13 trates a large-format printer-plotter model. 
14 

15 (a) General mechanics and electronics — In some 

16 such representative printers, a cylindrical platen 241 

17 (Fig. 4) — driven by a motor 242, worm and worm gear 

18 (shown as encircling the platen 241) under control of 

19 signals from a digital electronic processor 71 — rotates 
2 0 to drive sheets or lengths of printing medium 4A in a 

21 medium- advance direction. Print medium 4A is thereby 

22 drawn out of a supply of the medium and past the marking 

23 components that will now be described. 

24 A pen-holding carriage assembly 220 carries several 
2 5 pens, as illustrated, back and forth across the printing 
2 6 medium, along a scanning track — perpendicular to the 

2 7 meditom- advance direction — while the pens eject ink. For 

28 simplicity's sake, only four pens are illustrated; how- 

2 9 ever, as is well known a printer may have six pens or 

3 0 more, to hold different colors — or different dilutions 
31 of the same colors as in the more-familiar four pens. The 
3 2 medi^am 4A thus receives inkdrops for formation of a de- 

3 3 sired image. 
34 
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9 
10 
11 
12 



1 A very finely graduated encoder strip 233, 236 is ex- 

2 tended taut along the scanning path of the carriage assem- 

3 bly 220 and read by a very small automatic optoelectronic 
sensor 237 to provide position and speed information 237B 

5 for one or more microprocessors 71 that control the opera- 

6 tions of the printer. One advantageous location (not 

7 shown) for the encoder strip is immediately behind the 

8 pens . 

A currently preferred position for the encoder strip 
233, 236 (Fig. 4), however, is near the rear of the pen 
carriage — remote from the space into which a user's 
hands are inserted for servicing of the pen refill car- 

13 tridges. For either position, the sensor 237 is disposed 

14 with its optical beam passing through orifices or trans- 

15 parent portions of a scale formed in the strip. 

16 The pen-carriage assembly 220, 220' is driven in 

17 reciprocation by a motor 231 — along dual support and 

18 guide rails (not shown) — through the intermediary of a 

19 drive belt 235. The motor 231 is under the control of 

20 signals 231A from the processor or processors 71. 

21 Preferably the system includes at least four pens 

22 holding ink of, respectively, at least four different col- 

23 ors. Most typically the inks include yellow Y, then cyan 

24 C, magenta M and black K — in that order from left to 

25 right as seen by the operator. As a practical matter, 

2 6 chromatic-color and black pens may be in a single printer 

2 7 either in a common carriage or plural carriages. 

28 Also included in the pen-carriage assembly 220, 220' 

2 9 is a tray carrying various electronics. Fig. 4 most 

3 0 specifically represents a system such as the Hewlett Pac- 
31 kard printer/plotter model ^^DesignJet 2000CP", which does 
3 2 not include the present invention. These drawings, how- 
3 3 ever, also illustrate certain embodiments of the inven- 
34 tion, and — with certain detailed differences mentioned 
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1 below — a printer /plotter that includes preferred embodi- 

2 ments of the invention. 

3 

4 Before further discussion of details in the block 

5 diagrammatic showing of Fig, 4, a general orientation to 

6 that drawing may be helpful. This diagram particularly 

7 represents preferred embodiments of one previously dis- 

8 cussed apparatus aspect of the invention. 

9 Conventional portions of the apparatus appear as the 

10 printing stage 220 , . . 251, and 4A, discussed above, and 

11 also the final output-electronics stage 78 which drives 

12 that printing stage. This final-output stage 78 in turn 

13 is driven by a printmasking stage 75, which allocates 

14 printing of ink marks 218, 219 as among plural passes of 

15 the carriage 220, 220^ and pens across the medium 4A. 

16 Also generally conventional are a nonvolatile memory 

17 77, which supplies operating instructions 66 (many of 

18 which are novel and implement the present invention) for 

19 all the programmed elements; an image -processing stage 73, 
2 0 rendition-and- scaling module 74; and color input data 70 

21 seen at far left in the diagram. The data flow as input 

22 signals 191 into the processor 71. 

2 3 Features particularly related to the apparatus aspect 

24 of the invention appear in the upper and upper-central re- 

25 gion of the diagram as element 72, and elements 80 through 

26 89; these will be detailed below. Given the statements of 

27 function and the diagrams presented in this document, a 
2 8 programmer of ordinary skill — if experienced in this 

2 9 field — can prepare suitable programs for operating all 

3 0 the circuits. 

31 The pen-carriage assembly is represented separately 

32 at 220 when traveling to the left 216 while discharging 

33 ink 218, and at 220' when traveling to the right 217 while 

34 discharging ink 219. It will be understood that both 220 
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and 220' represent the same pen carriage, with the same 
pens . 

The previously mentioned digital processor 71 pro- 
vides control signals 220B, 220^^6 to fire the pens with 
correct timing, coordinated with platen drive control 
signals 242A to the platen motor 242, and carriage drive 
control signals 231A to the carriage drive motor 231 . The 
processor 71 develops these carriage drive signals 23 lA 
based partly upon information about the carriage speed and 
position derived from the encoder signals 237B provided by 
the encoder 237. 

(In the block diagram all illustrated signals are 
flowing from left to right except the information 237B, 65 
fed back from the sensors 237, 251 — as indicated by the 
associated leftward arrows — and analogously the previ- 
ously mentioned information 66 where shown passing to the 
calibrating means 72, in a nonstandard direction.) The 
codestrip 233, 236 thus enables formation of color ink- 
drops at ultrahigh precision during scanning of the car- 
riage assembly 220 in each direction — i. e. , either left 
to right (forward 220') or right to left (back 220). 

The invention is not limited to operation in four- 
colorant systems. To the contrary, for example six-col- 
orant ^^CMYKcm'' systems including dilute cyan '^c" and ma- 
genta ^^m^^ colorant are included in preferred exribodiments . 

The integrated circuits 71 may be distributive — be- 
ing partly in the printer, partly in an associated compu- 
ter, and partly in a separately packaged raster image 
processor. Alternatively the circuits may be primarily or 
wholly in just one or two of such devices. 

These circuits also may comprise a general -purpose 
processor ( e. g. the central processor of a general -pur- 
pose computer) operating software such as may be held for 
instance in a computer hard drive, or operating firmware 
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1 ( e. g. held in a ROM 77 and for distribution 66 to other 

2 components) , or both; and may comprise application- spe- 

3 cific integrated circuitry. Combinations of these may be 

4 used instead. 

5 

6 The novel features appear primarily in the color- 

7 calibrating processing portions 72 — which include a two- 

8 stage interpretive system 79, 83. Also novel in this con- 

9 text is a module 80 for controlling the final output stage 

10 78 and printing stage 220 . . . 251, and 4A, to generate a 

11 test pattern for interpretation by the second (lineariza- 

12 tion) stage 83. 
13 

14 (b) Sensor-to-perceptual calibration — In first op- 

15 eration of the calibrating portions 72, the system scans 

16 the line sensor — which is another small optical sensor 

17 251 that also rides on the carriage — over a preprinted 

18 test pattern known to be linear. This sensor is detailed 

19 in the previously mentioned patent document of Soler (see 
2 0 Fig. 5 and discussion in that document) , 

21 The result is a signal stream 65 from the sensor 251 

22 to the first stage 79, which calibrates the sensor (as 

23 distinguished from linearizing the printing system) . This 

24 stage 79 includes a front end 62 that reads and preinter- 

25 prets the known-linear test pattern — and as earlier ex- 
2 6 plained does so for only one single printing medium. 

27 Based on the interpreted data, the main section 63 of 

2 8 the first-stage calibration module 79 determines conver- 

2 9 sion factors at multiple points — or a spline-like func- 

3 0 tion, as mentioned earlier. Resulting calibration data 

31 are stored in a memory 64; as a practical matter, this 

32 memory may be part of the nonvolatile memory 77. 

33 Calibration of the sensor is thus completed. The 

34 calibration data remain in the memory 64 for use until the 
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1 sensor requires recalibration due to changing of the sen- 

2 sor, or its aging, or accumulated ink spray on its optical 

3 window, or other events that may be suspected to modify 

4 the actual response of the sensor and so require a new 

5 calibration. 
6 

7 (c) Printing- system linearization — Next, for actu- 

8 al linearization of the printing system — now relying on 

9 the already- calibrated sensor — the control module 80 

10 provides signals 81 to the final output stage 78, inducing 

11 that stage to operate the printing stage 220 . . . 251, 

12 and 4A, to generate a new test pattern. This test pattern 

13 is not known to be linear, and in fact the purpose of 

14 printing it is specifically to determine its nonlineari- 

15 ties and a transfer function required to essentially elim- 

16 inate them. 

17 Unlike the single test pattern used for the sensor 

18 calibration described above, the linearization test pat- 

19 tern now under discussion should be printed on each dif- 
2 0 ferent printing medium that is to be used in the printer. 

21 Of course it is not necessary if the operator is not con- 

22 cerned with tonal linearity in some particular project. 

2 3 It also is not necessary to perform such printing and 

24 linearization for all the printing media at one time. 

2 5 Rather, these operations can be performed when a particu- 

2 6 lar type of print medium is about to be used for the first 

2 7 time, or after this type of medium has not been used for a 

2 8 long while — and also if the printheads or inks have been 

2 9 changed . 

3 0 After the new test pattern has been printed, then 

31 again the sensor 251 is scanned over the pattern as in the 

3 2 sensor calibration — but resulting data 82 from the sen- 

3 3 sor now flow to the second, linearization stage 83 of the 

3 4 calibration module 72, Here the data are interpreted 84 
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1 in an analogous manner to that in earlier module 62, but 

2 the interpretive calculations are aimed not at conversion 

3 factors for use of the sensor but rather at determining 

4 errors of linearization in the pattern. 

5 From those errors, the next submodule 85 develops a 

6 linearization profile, or transfer function, that will 

7 later be used to adjust input color data to achieve print- 

8 out linearity. Still within the processor 71 and at the 

9 output stage of its calibrating unit 72, this lineariza- 

10 tion submodule 85 transmits the adjustment data 89 into 

11 the previously mentioned nonvolatile memory 77 for storage 

12 in a transfer-function memory bank 86. 

13 In this process, one or more of various forms of the 

14 transfer- function information 89 — whether in the form of 

15 coefficients for use in a formula, or in the form of a 

16 lookup table — are then stored in their particular dedi- 

17 cated portion 86 of the memory 77, The transfer- function 

18 information is retrieved from that memory bank 86 and pas- 

19 ses 87 into the color-adjustment module 76, whenever nee- 

2 0 ded to guide the operation of that module in preparing the 

21 input data 70 for later transformations 74, 75, 78 and 

22 thereby for eventual printing in the printing stage. 
23 

24 
25 

26 The cibove disclosure is intended as merely exemplary, 

27 and not to limit the scope of the invention — which is to 
2 8 be determined by reference to the appended claims. 
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